A CHARACTERIZATION OF THE FERMAT QUARTIC K3 
SURFACE BY MEANS OF FINITE SYMMETRIES 
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Abstract. We shall characterize the Fermat quartic K3 surface, among all 
K3 surfaces, by means of its finite group symmetries. 



1. Introduction 

The aim of this note is to characterize the Fermat quartic surface, among all 
complex K3 surfaces, in terms of finite group symmetries. Our main result is 
theorem 1.2. 

Throughout this note, we shall work over the complex number field C. By a 
K3 surface, we mean a simply-connected smooth complex surface X which ad- 
mits a nowhere vanishing global holomorphic 2-from u>x ■ As it is well known, K3 
surfaces form 20-dimensional families and projective ones form countably many 
19-dimensional families [PSS]. Among them, one of the simplest examples is the 
Fermat quartic surface: 

i : X 4 := (xf + x\ + x\ + x\ = 0) c P 3 . 

From the explicit form, we see that X± admits a fairly large projective transfor- 
mation group, namely, 

•^384 := (a4 : S 4 )/fj,4 = : S 4 . 

Here the symbol A : B means a semi-direct product (A being normal) and fii := ((1) 
(Cr := e 2 ™/ 7 ), the multiplicative subgroup of order / of C x . This group F384 is 
a solvable group of order 4 3 ■ 4! = 2 9 • 3. The action by F384 is an ovbious one, 
that is, /if, or /i|/^4 acts on X4 diagonally and S4 acts as the permutation of the 
coordinates. 

Let F128 be a Sylow 2-subgroup of F384. Then F128 is a nilpotent group of order 
2 9 . We have an action by F128 on X 4 which is a restriction of the action by ^384- 
We call the action 



^384 : F384 x X4 — ► X 4 , resp. 112& : F128 x X4 — ► X 4 

defined here, the standard action by F384 (resp. by Fi2g) on X4. Note that F384 
has exactly 3 Sylow 2-subgroups, corresponding to the 3 Sylow 2-subgroups (~ Dg) 
of S4. However, they are conjugate one another by the Sylow theorem, and their 
standard actions on X4 are isomorphic to one another in the sense below. The 
group F12S is also interesting from the view of Mukai's classification of symplectic 
K3 groups [Mu]. In fact, it is an extension of a Sylow 2-subgroup F128 of the 
Mathieu group M23 by /U4 from the right (see also section 2). 
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Definition 1.1. We call a finite group G a K3 group (on X) if there is a faithful 
action by G on X, say, p : G x X — ► X. Let Gi be a K3 group on X, acting by 
Pi : Gi x X, — > X, (i = 1, 2). We say that (Gi, Xi,pi) are isomorphic if there are 
a group isomorphism / : Gi ~ G2 and an isomorphism : Xi ~ X 2 such that the 
following diagram commutes: 

G2 x X2 -f— > X2 

/x^T T v 

Gi x Xx Xx 
The aim of this note is to show the following theorem: 

Theorem 1.2. (%) Let G be a solvable K3 group on X acting by p : G x X — ► X. 

TTien |G| < 2 9 • 3. Moreover, if \G\ = 2 9 • 3 (= 1536), toen Pic(X) G = ZH, 

(H 2 ) — 4 and (G,X,p) ~ (i*384 5 X4, £384), ifte standard action by F384 on the 

Fermat quartic surface X 4 . 
^ Lei G be a nilpotent K3 group on X acting by p : G x X — ► X. TTien 

|G| < 2 9 . Moreover, z/|G| = 2 9 , then Pic(X) G '= ZH , (ff 2 ) = 4 and (G, X, p) ~ 

(F 12 8, X 4 , ix28), i^e standard action by i^x28 on X4. 

The most basic class of finite groups is the class of cyclic groups of prime order. 
This class is extended to the following sequences of important classes of groups of 
rather different nature: 

(abelian groups) C (nilpotent groups) C (solvable groups) ; 
(quasi-simple non-commutative groups) C (quasi-perfect groups) , 
where a quasi-simple non-commutative group (resp. a quasi-perfect group) is a 
group which is an extension of a simple non-commutative group (resp. a perfect 
group) by a cyclic group from the right. 

From the view of these sequences, our theorem is regarded as both an analogy 
and a counter part of previous works of Kondo [Ko2] for the quasi-perfect K3 group 
M20 : H4, which is also the group of the maximum order among K3 groups, and 
Zhang and the author [OZ] for the quasi-simple non-commutative group L 2 (7) x ^4. 
In terms of the coarse moduli space M.^ of quasi-polarized K3 surfaces of degree 
4, our theorem says that the large stabilizer subgroups i 7 ^, Fx28 identify the 
point corresponding to the Fermat K3 surface (naturally polarized by 1) in M4. 
However, our theorem claims much more, because we do not assume in a priori a 
degree of invariant polarization. Indeed, as in [OZ], the determination of the degree 
of invariant polarization is one of the key steps in our proof (proposition (3.3) and 
section 6). For this step, we apply Kondo's embedding theorem [Kol, Lemmas 5, 
6] (see also (6.2) and (6.3)) as in [Ko2] and [OZ]. On the other hand, our theorem 
can be also viewed as a characterization of a 2-group Fx28 by means of geometry. 
It might be worth noticing the following table in [Ha, Page 11] of the number p{n) 
of isomorphism classes of 2-groups of order 2": 



n 


1 


2 


3 


4 


5 


6 


7 


8 


9 


p(n) 


1 


2 


5 


14 


51 


267 


2328 


56092 


10494213 



Section 2 is a summary of known results, relevant to us, about K3 groups from 
Nikulin [Ni] and Mukai [Mu], In section 3, we reduce our theorem to three propo- 
sitions (propositions (3.1), (3.2), and (3.3)). In sections 4, 5 and 6, we prove these 
three propositions. 
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2. Some basic properties of K3 groups after Nikulin and Mukai 

Let X be a K3 surface and G be a K3 group acting on X by p : G x X — ► X. 
Then G has a 1-dimensional representation on H°(X, Ct x ) = Cu>x by g*u>x = 
a(g)u>x, and we have the exact sequence, called the basic sequence: 

1 — ► Gn '■= Kcra — ► G-^pi — ► 1 . 

We call Gn the symplectic part and pj (resp. I) the transcendental part (resp. the 
transcendental value) of the action p : G x X — ► X. 

By the basic sequence, the study of K3 group is divided into three parts: study of 
symplectic K3 groups Gn, study of transcendental values I, and study of possible 
extensions of symplectic parts by transcenental parts from the right. 

Example 2.1. The group F384 = {p\ : £ 4 )/^4 fits into the following exact se- 
quence: 

1 ► * ^384 >S± > 1 • 

Then the group ((1324), (34)) ~ D s is a (one of three) Sylow 2-subgroup of £4 and 
p- 1 (((1324), (34))) is a (one of three) 2-Sylow subgroup of F 3S4 . We fix F 12 $ as this 
subgroup. The basic sequences of the standard actions by F384 and by F128 on the 
Fermat K3 surface X4 are as follows: 

1 > -?384 := (^384)jV * ^384 >£*4 ► 1 j 

1 > F12H ■= (Fi2$)n * A28— »M4 * 1 • 

The orders of the symplectic parts F 38 4 and F 12 s are 384 = 2 7 • 3 and 128 = 2 7 
respectively. Moreover, both basic sequences split: i 7 ^ = F384 : p 4 and F128 = 
F 128 : Pa- Here the splittings are given by a(diag (1, 1, 1, £4)) = (4. 

The next theorem by Nikulin [Ni] is the first important result about the sym- 
plectic part: 

Theorem 2.2. [Ni] Let g e Gn- Then ordg < 8. The fixed locus X 9 is a finite set 
(if g ^ 1) and the cardinality \X 9 \ depends only on ordg as in the following table: 



ord(g) 


1 


2 


3 


4 


5 


6 


7 


8 


\X°\ 


X 


8 


6 


4 


4 


2 


3 


2 



Let := {1,2, • • • ,24} be the set of 24 elements and V(ft) be the power set 
of CI, i.e. the set of all subsets of CI. As it is classically known (see for instance 
[CS, Chap. 10]), V(Cl) has a very remarkable subset ££(5,8,24), called the Steiner 
system. St(5, 8, 24) is defined to be a subset of V{Cl) consisting of 8-element subsets 
such that for each 5-element subset B of Cl, there is exactly one A e St(5, 8, 24) 
such that B C A. Such subsets St(5, 8, 24) of T{Q) are known to be unique up 
to AutfJ = S 2i and satisfy |St(5,8,24)| = 759. We fix one of such ££(5,8,24). 
The Mathieu group M 2 4 of degree 24 is then defined to be the stabilizer group of 
££(5,8,24): 

M 24 := {r e Aut(O) = £ 24 |r(££(5, 8, 24)) = ££(5,8,24)} . 
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It is well known that M24 is a simple (sporadic) group of order 2 10 • 3 3 • 5 • 7 • 11 • 23 
and 5-transitively acts on f2 (eg. [CS, ibid]). The Mathieu group M23 of degree 23 
is the stabilizer group of one point, say 24 <= il, i.e. M23 '■= {t S M2a\t(2A) = 24}. 
M 23 is also a simple group and is of order |M 23 | = |M 24 |/24 = 2 7 • 3 2 • 5 ■ 7 • 11 ■ 23. 
By the definition, both M24 and M 23 act naturally on £1. 

Mukai [Mu] discovered the following very beautiful theorem: 

Theorem 2.3. [Mu, main theorem] Let K be a finite group. Then K is a symplectic 
K3 group on some K3 surface X if and only if K is isomorphic to a subgroup of 
M23 having at least 5-orbits on £1 (under the action induced by the action by M23 on 
CI). Moreover, with respect to the inclusion as abstract groups, there are exactly 11 
maximal such groups. The groups M 2 q and F 3S 4 are the ones of two largest orders, 
which are \M 2Q \ = 960 and |F 384 | = 384. 

Later, Xiao [Xi] and Kondo [Ko] gave alternative proofs respectively. In the 
course of proof, Xiao shows that there are exactly 80 isomorphism classes of sym- 
plectic K3 groups (as abstract groups). In our proof of the main result (1.2), we 
shall also exploit an idea of Kondo's alternative proof (section 6). 

We emphasize the following consequence: 

Corollary 2.4. -F128 is isomorphic to a Sylow 2-subgroup 0/M23. 

Proof. By example H2.1|l and theorem (|2.3|l . we have F128 < M23. Moreover, since 
|Fi2s| = 2 7 and |M 23 | = 2 7 • k ((2, fc) = 1), the result follows from the Sylow 
theorem. □ 

Next we recall basic properties of the transcendental part hi of a K3 group on 
X from [Ni] and [MO]. By (p(I), we denote the Euler function of /, i.e. ip(I) = 
|Gal(Q(C/)/Q)|. Note that <p{I) is even unless I = 1,2. 

As it is observed in [Ni], X is projective if I > 2. Indeed, if I > 2, then the 
quotient surface X/G is either a rational surface with quotient singularities or an 
Enriques surface with at worst Du Val singularities, both of which are projective. 
In the rest of section 2, we assume that X is projective. 

Let NS(X) be the Neron-Severi lattice of X and T(X) the transcendental lattice, 
i.e. the orthogonal complement of NS(X) in H 2 (X, Z) with respect to the cup 
product: 

T{X):={xeH 2 {X,Z)\(x,~NS(X)) = 0} . 
Then, NS(X)eT(X) is a sublattice of finite index of H 2 (X, Z) (by the projectivity 
of X). T(X) is also the minimal primitive sublattice of H 2 (X, Z) such that the 
scalar extension by C contains the class of u>x (by the Lefschetz (1, l)-theorem). 
Since b 2 (X) = 22, we have 2 < rankT(Jf) < 21. 

Theorem 2.5. ([Ni], see also [MO] for (2), (4)) 

(1) Gn acts on T{X) as identity. 

(2) Set G/Gjsi = {g modGpi) — (J-i- Then, there is a natural isomorphism 



T(X) ~ Z[0 



en _ rankTjX) 



<P{I) 

as Z[£i]-modules. Here, Zi[Q]-module structure on T(X) is given by f{C,i)x := 
/Of)*- 

(3) tp(I)\rankT(X). In particular, tp(I) < 20 and I < 66. Moreover, I = 1,2,3,4,6 
if <p(I) < 2 and I = 5, 8, 10, 12 if <p(I) = 4. 
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(4) I 7^ 60. Conversely, each I such that <p(I) < 20 and I ^ 60 is realized as a 
transcendental value of some K3 group. There are exactly 40 such I . (For the 
explicit list, see [MO].) 

As we reviewed above, both symplectic part and transcendental part are now well 
understood. However, the K3 groups, i.e. all the geometrically possible extensions 
of 80 symplectic parts by 40 transcendental parts, are not yet classified completely. 
This problem is now in progress in the work [10Z] by A. fvanov, De-Qi Zhang and 
the author. 

We close section 2 by recalling the following group theoretical nature of F\2% 
from [Xi]: 

Proposition 2.6. (1) The order structure of -F128 is as follows: 



order 


1 


2 


4 


8 


cardinality 


1 


35 


76 


16 



(2) The commutator subgroup [.Fi28> -Pi2s] of Fi2% is isomorphic to C2 X Dg, where 
C n is a cyclic group of order n and Dm is a dihedral group of order 2n. 

(3) F\2& has a subgroup isomorphic to the binary dihedral group of order 16: 

Qi 6 := (a, b\a 8 = 1, a 4 = b 2 , b^ab = a" 1 ) . 

Proof. One can read off all these informations from Xiao's table [Xi]. Of course, 
one can directly check each statement from explicit descriptions of -F128 and -F128 
in example (|2.1|l . For instance, we have the following descriptions in PGL(4, C): 

P128 = {[(Cr^U))]W G ((1324), (34)>(~ D B ), sgn{a) ■ II^xC = 1} 

[Fix, Fi2 S ] = (A, B, C)~C 2 xD s ; F 128 > (P, Q) ~ Q 16 , 

where 



A = 



(1 
























M 








/o 


1 










1 










B = 




C4 










c 




1 

















-1 





3 







1 


















1 










- 1 ) 








^0 













v» 





1 


0/ 








(0 


1 











(u 








o\ 














p = 


C4 



v» 









1 







c 4 y 


, Q 







{0 


C4 








1 




1 

0/ 











All the statements also follow from these descriptions. □ 

3. Reduction of the main theorem to three propositions 

In this section, we reduce the main theorem (1.2) to the following three propo- 
sitions: 

Proposition 3.1. Let X be a projective K3 surface. Assume that Q\q is a sym- 
plectic K3 group on X. Then 

(1) NS(X)Q 16 = ZH , where H is an ample class on X. 

(2) If, in addition, (H 2 ) = 4, then the polarized K3 surface (X,H) is unique up to 
isomorphism. In particular, (X,H) ~ (X^^Hi), where X^ is the Fermat quartic 
K3 surface and H4 := t*C P 3(l) under the natural inclusion 1 : X4 C P 3 . 
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Proposition 3.2. (1) Let G be a K3 group on X such that Gn — 7*384- Then the 
transcendental value I of G is either I, 2, or 4. 

(2) Let G be a solvable K3 group on X. Then \G\ < 2 9 • 3. Moreover, if \G\ = 
2 9 • 3 ; then the symplectic part Gn is necessarily isomorphic to F 38 4 and the 
transcendental part is isomorphic to fj, 4 . 

(3) Let G be a K3 group on X such that Gn — F12& ■ Then the transcendental value 
I of G is either 1, 2, or 4. In particular, G is a 2-group and nilpotent. 

(4) LetG be a nilpotent K3 group on X . Then \G\ < 2 9 . Moreover, if\G\ = 2 9 , then 
the symplectic part Gn is necessarily isomorphic to i*i 28 and the transcendental 
part is isomorphic to n 4 . 

Proposition 3.3. Let X be a K3 surface. Assume that X admits a K3 group G 
of order 2 9 . Then X is projective and NS(X) G = ZH, where H is an ample class 
such that (H 2 ) = 4. 

We shall prove these three propositions in sections 4, 5, 6 respectively. In the 
rest of this section, we show that these propositions imply the main result (1.2). 

Proof of "(3.1), (3.2) and (3.3) imply (1.2)" 

Let Y be a K3 surface admitting a K3 group F such that \F\ = 2 9 • 3. Let G 
be a Sylow 2-subgroup of F. Then \G\ — 2 9 and G is a nilpotent group. (Here 
we recall that any p-group is nilpotent.) Then, by (3.2)(4), Gn — -F128 an d 7 = 4. 
In particular, Y is projective by I > 2. Recall that Qi§ is a subgroup of F128 by 
(2.6)(3). Then, we have embeddings: Qi 6 < F 12 $ < G < F. Thus 

ns(y) f c ns(f) g c NS(r) Fi2s c NS(r) Qie = zh . 

Here we use (3.1) (1) for the last equality. Since NS(F) F contains an ample invariant 
class, say J2 g eF 5*^' ^ being ample on Y, we have then: 

NS(y) F = ns(f) g = ns(f) Fi2s = NS(r) Qie = zh . 

Hence F < Aut(X,H). Moreover, (H 2 ) = 4 by (3.3). Hence, ip : (X,H) ~ 
(X4,H4) by (3.1)(2). Then, under the isomorphism F ~ f^ 1 oFoif, we have 
((X,H),F) ~ ((X 4 ,H 4 ),F). So, we may identify ((X,H),F) = ((X 4 ,H 4 ),F). 
Under this identification, we have 

F < Aut(Xi, Hi) > F 384 > F 384 . 

Note that Aut(X4, H4) is a finite group. This is because Aut(X4, H4) is a discrete 
algebraic subgroup of PGL(P 3 ), whence, finite. Thus, [Aut(X4, .H4) : F 38 4] < 4 by 
(3.2)(1) and (2.3). Hence |Aut(X 4 , H 4 )\ < 2 7 • 3 x 4 = 2 9 • 3. Since |F 384 | = |F| = 
2 9 • 3, we then obtain F = Aut(X4,i/ 4 ) = F 384 . This implies the assertion (1) of 
the main theorem. 

Next, we shall show the assertion (2) of the main theorem. Let X be a K3 surface 
admitting a K3 group G such that \G\ = 2 9 . Then, by repeating the same argument 
as above, we can identify ((X,H),G) = ((X4, H4), G). Since Aut(X 4 ,if 4 ) = F 384 , 
our G is a subgroup of -F 384 . Since |-F 384 | = 2 9 • 3 and \G\ = 2 9 , it follows that G 
is one of three Sylow 2-subgroups Fi2 8 of F 384 , which are conjugate one another in 
-F 384 . This implies the result. 

Remark 3.4. As a byproduct, we have obtained that Aut(X 4 , H4) = F 384 . One can 
also derive this equality by a more direct calculation along the same line as in [Sh] . 
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We also notice that p(X±) = 20 and, by [SI], the full automorphism group Aut(A^) 
is an infinite group. 

4. Polarized K3 surface of degree 4 with a symplectic <5i6-action 

In this section, we shall prove proposition (3.1). 
Definition 4.1. The binary dihedral group Qi m of order 4m is defined by 

Q 4m := (a, b\a 2m = 1, a m = b 2 , b^ab = a' 1 ) . 
Qi m is realized as a linear subgroup of GL(2, C) as 

(«:=( C2 m c °i),&:=(£ o) > = K.«"6|0<n<2m-l}. 

The next two lemmas (4.2) and (4.4)(=(3.1)(1)) explain the reason why we pay 
a special attension to the particular group Qi6- 

Lemma 4.2. Any projective representation of Qi m is induced by a linear represen- 
tation, i.e. for any group homomorphism p : Qi m — ► PGL(n, C) := GL{n, C)/C x , 
there is a group homomorphism p : Q^ m — ► GL(n, C) such that p = p o p 7 where 
p : GL(n, C) — ► PGL(n, C) is the quotient map. 

Proof. We shall write [X] = A"modC x for X E GL(n, C). First we remark that 
Qim = (a,b\a m = b 2 ,b~ 1 ab = a -1 ). This is because a m — b 2 and b~ x ab = a -1 
imply that a -" 1 = b- l a m b = 6" 1 6 2 6 = b 2 = a m , whence a 2m = 1. Let p(a) = [A] 
and p(b) = [B]. Then, [A m ] = [B 2 ] and [B^AB] = [A" 1 ]. I.e. A rn = aB 2 and 
B~ X AB = fiA^ 1 in GL(n, C) for some a,f3 e C x . By replacing the representative 
A by A/y/Ji, one has B~ 1 AB = A^ 1 . Next, by replacing the representative B 
by yfaB, one obtains B~ x AB = A' 1 and A m = B 2 . Therefore we have a group 
homomorphism p : Q^ m — ► GL(n, C) defined by p(a) = A and p(b) = B. This p 
satisfies p — p o p. □ 

Remark 4.3. Consider the dihedral group -Ds := (a,6|a 4 = b 2 = l,b~ 1 ab = a -1 ). 
Then the map 




defines a projective representation p : D$ — > PGL(2, C). However, this is not 
induced by any linear representation — ► GL(2, C). 

Lemma 4.4. Lef X be a projective K3 surface admitting a symplectic K3 group 
Q w . Then rankT(X) = 2 and NS(X) Ql6 = ZH for some ample class H. 

Proof. The following very useful lemma is essentially due to Mukai [Mu] . 

Proposition 4.5. Let X be a projective K3 surface admitting symplectic K3 group 
G. Then 

(1) 

1 8 

rankH 2 (X, Z) G - —(24 + ]T m(n)/(n)) - 2 , 

' ' n— 2 

where m(n) is the number of elements of order n in G and f{n) is the number 
of the fixed points in (2.2). 
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(2) rankH 2 (X,Z) G > 3. Moreover, if rankH 2 {X,Z) G = 3, then rankT(X) = 2 
and NS(X) G = ZH for some ample class H. 

Proof. Consider the action by G on the total cohomology group H*(X, Z) = 
H°(X, Z) H 2 (X, Z) H 4 (X, Z). Then, by the representation theory, one has 

rank J ff*(X,Z) G = i-^tr(. 9 *|i/*(X,Z)) . 

|G| sec 

By the Lefschetz fixed point formula, each summand satisfies 

tv(g*\H*(X,Z))=e(X9) . 

Here e(*) is the topological Eulcr number of *. Now, by (2.2) and e(X) = 24, we 
have 

1 8 

rankiT(X, Z) G = —(24 + V m(n)/(n)) . 
I G I „=2 

Since G acts trivially on H°(X, Z) ~ H A (X, Z) ~ Z, we have the assertion (1). 
Since X is projective, X has an invariant ample class. On the other hand, since 
G is symplectic, T(X) is a subset of H 2 (X, Z) G and is of rank at least 2. Thus, 
rankiJ 2 (X, Z) G > 3, and if the equality holds, then we have rankT(X) = 2 and 
NS(X) G — ZH for some ample class H. This completes the proof. □ 

We also remark the following: 

Lemma 4.6. The order structure of Qi§ is as follows: 



order 


1 


2 


4 


8 


cardinality 


1 


1 


10 


4 



Proof. This directly follows from the description of Qiq. □ 
Let us return back to (4.4). By (4.5) and (4.6), we calculate that 

ranki/ 2 (X,Z) Ql6 = — (24 + 8 • 1 + 4 • 10 + 2 • 4) - 2 = 3 . 
16 

This completes the proof of (4.4). □ 

Recall that the standard action by Fi 2 $ on X4 is a symplectic action on the 
polarized K3 surface (X4, H4) and Qiq < F 12 s- Now, the next proposition completes 
the proof of proposition (3.1): 

Proposition 4.7. Polarized K3 surfaces (X, H) of degree 4 which admit a sym- 
plectic K3 group Qie (which keeps H invarinat) are unique up to isomorphism as 
polarized K3 surfaces. 

Proof. Since rankNS(X) c ? 16 = 1 and H e NS(X) is primitive by (H 2 ) = 4 and by 
even-ness of the intersection numbers, we have NS(X) < ^ 16 = ZH . Then \H\ has no 
fixed components. Indeed, the fixed part of \H\ must be also <5i6-invariant, while 
NS(X) ( 3 16 = ZH. Therefore, the ample linear system \H\ is free by [SD]. Note that 
dim|_ff| = 3 by the Riemann-Roch formula and by (H 2 ) = 4. Then \H\ defines a 
morphism 

$ := : X — > P 3 = \H\* ; x ^ {D e \H | | D 3 x } . 
This $ is either 

(I) an embedding onto a (smooth) quartic surface W = (4), or 



FERMAT QUARTIC SURFACE 



9 



(II) a finite double cover of an irreducible, reduced quadratic surface W — (2). 

Since H is <5i 6 -invariant in Pic(X) ~ NS(X), the divisor g*D is linearly equiv- 
alent to D whenever D € \H\ and g € Qw- Thus, the group Qie induces a 
<f>-equivariant, projective linear action on the image W. By (4.2), this action is also 
induced by a linear co-action by Qi6 on H°(X,Ox(H)) = ®j =1 Cxi. 

In order to complete the proof, it suffices to show the two assertions, that the 
case (II) can not happen (4.9) and that the image W is uniquely determined up to 
projective transformations of P 3 in the case (I) (4.11). 

In both assertions, we need the following classification of the complex irreducible 
linear representations of Qiq = (a, 6|a 4 = b 2 , b~ 1 ab = a -1 ): 

Lemma 4.8. A complex irreducible linear representation of Qi & is isomorphic to 
one of the following 7 representations: 

pi.i i a i — ► 1, b i — ► 1 , pi.2 : a h- ► 1, b i— > — 1 , 
Pi. 3 : a — 1; b i — ^ 1 , pi.4 : a i ► — 1, b i ^ 1 , 

—ft c 8 °-)--a ^o)— (f c°0'-g 

"" :0 "(o CI 1 ) ■ 

Proof. These 7 representations are clearly irreducible and well-defined. Moreover, 
any two are inequivalent as linear representations (by looking at the trace of the 
matrices). Since 16 = l 2 • 4 + 2 2 • 3, these are all. □ 

Lemma 4.9. The case (II) can not happen. 

Proof. In what follows, assuming to the contrary that the case (II) happens, i.e. 
the image W is a quadratic surface, we shall derive a contradiction. 

Claim 4.10. (1) W is non-singular. 

(2) The induced action by Q\q on W is faithful. 

Proof. Note that a quadratic surface is normal if it is irreducible and reduced. 
Since $ is a finite double covering, it is also a Galois covering. Let r be the 
covering involution. Then W = X/t. Since W is a rational surface, t*lox = 
—lox- Thus, if P e X T , then there is a local coordinate (xp,yp) at P such that 
T*(xp,yp) = (xp, —yp). Hence, W is non-singular. The kernel of the natural map 
Aut(X, H) — ► Aut(W / , Ow(l)) is a subgroup of (r). Since t*lox = —^x, we have 
Qi6 n (t) = {1}. This means that the induced action by Qia on W is faithful. □ 

Let us return back to the proof of (4.9). Let us consider the irreducible decom- 
position of the co-action by Qiq on H°(X, Ox(H)) ~ C 4 . Note that the represen- 
tations /)2,i and /?2,2 are transformed by the outer automorphism a a 3 and b i— > b 
of Qiq. Recall also that the action must be faithful by (4. 10) (2). Thus, we may 
assume without loss of generality that p 2 ,i appears in the decomposition. Under 
this assumption, there are 4 possible decompositions: (i) p2,i ©P2.1, (ii) P2,i © p2,2, 
(iii) p2,i®P2,3, (iv) P2, iffi (two 1 — dimensional irreducible representations). Incases 
(i) and (ii), a 4 = id in PGL(4, C), a contradiction to (4.10)(2). 
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Consider the case (iii). Then the action by Qie on H°(X,Ox(H)) is given by 



a = 



/Cs 















C4 









CV 



/o 





a 









1 



under suitable basis (xi)j =1 oiH°(X, Ox(H)). Let us consider the defining equation 
F 2 (xi, x 2 , x 3 , X4) € Sym 2 H°(X,Ox(H)) of W. Then, F 2 is both a-semi-invariant 
and 6-semi-invariant, i.e. a(F 2 ) = a{a)F 2 and b(F 2 ) = a{b)F 2 . This a defines a 
1-dimensional representation of (5i6- Thus a(F 2 ) = ±F 2 and b(F 2 ) = ±F 2 . If 
a(F 2 ) — F 2 , then F 2 = ax\x 2 + fix 3 X4 by the explicit matrix form of a. Since 
b(F 2 ) — ±F 2 , we have then F 2 = ax\x 2 or (3x 3 X4. However, this contradicts the 
smoothness of W. If a(F 2 ) = —F 2 , then F 2 is of the form F 2 (x 3 ,X4) and again 
contradicts the smoothness of W. Thus, the case (iii) can not happen, either. 

Finally consider the case (iv). In this case, the action by Qie on H°(X, Ox(Fl)) 
is given by 



a = 








Cs 






±1 








±1/ 







a 










±1 








±v 



under suitable basis (xi)j =1 oiH°(X, Ox(H))- Let us consider the defining equation 
F 2 of VK. Then as before a(F 2 ) = ±F 2 and b(F 2 ) = ±F 2 . If a(F 2 ) = -F 2 , then F 2 = 
F 2 (xs, X4) and W is singular, a contradiction. Consider the case where a(F 2 ) = F 2 . 
By the explicit form of a, we have F 2 = axix 2 + f 2 (x 3 , X4). Since W is non-singular, 
we have a / and f 2 =/= 0. Since b(xix 2 ) — —x\x 2l we have b(f 2 ) = —fa. Thus, 
again by the explicit form of b, it follows that F 2 = axix 2 + (3x 3 X4 for some non-zero 
constants a, (3. After replacing xi by their multiples and the order of x 3 and X4 
if necessary, we finally normalize the equation of W as F 2 = x\x 2 + X3X4 and we 
have: 




-1 




/Cs 




















or 



and b 



C4 





C4 







o\ 




-V 



Then, it follows that W a 
P 2 = [0 : 1 : : 0], P 3 = [0 



S 1 , where P x = [1 : : : 0], 
: : 1]. Since the actions by 



/Cs \ 

Cs" 1 
0-10 

\o -1/ 

W a 2 = W a* = {p.}4 =l = 

: 1 : 0] and P 4 = [0 : 
Qi6 on X and on Ly are $-equivariant and since $ is a finite morphism of degree 2, 
it follows that a 2 and a 4 act on T := ^(S) as identity. Thus X°? = X a * = T. On 
the other hand, \X a \ = 4 and \X a | = 8 by (2.2), a contradiction. This completes 
the proof of (4.9). □ 

Lemma 4.11. Assume that the case (I) happens, i.e. that $ : X ~ W = (4) C P 3 . 

Then W — (x\+x\+x\x4+x 3 x\ = 0) in a suitably chosen homogeneous coordinates 
ofP 3 - 



Proof. Set W — (^4(2:1, x 2 , x 3 , x 4 ) = 0). We note that $-equivariant action by 
Qie on W is symplectic and faithful. As in the previous lemma (4.9), we consider 
the irreducible decomposition of the co-action by Qie on H°(X,Ox(Ftj)- Again 
as before, we may assume that p 2 ,i appears in the decomposition. Under this 
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assumption, there are 4 possible decompositions: (i) p2,i © P2,i, (ii) P2,i © P2,2, (iii) 
P2,i © P2,3, (iv) p2,i © (two 1 — dimensional irreducible representations). As before, 
the cases (i) and (ii) are ruled out by a 4 = id in PGL(4, C). 

Claim 4.12. The case (iii) does not happen. 

Proof. Assume that the case (iii) happens. Then the action by Qiq on H°(X, Ox (H)) 
is given by 



a = 






under suitable basis (x 



Cs 






C4 





o \ 



c 4 -y 



/o 

C4 

o 



a 









1 

0/ 



l =1 of H°(X,Ox(H)). Since deta = 1 and a*cuw = %, 
it follows that F4 is a-invariant. By the explicit form of a, the equation F4 must 
be then of the following form: 

F4 — Ctx\x\ + (3X1X2X3X4 + f4(X3, X4) . 

However the point [1 : : : 0] is then a singular point of W, a contradiction. 
In what follows, we shall consider the case (iv). Note that 



□ 



/Cs 





C 8 






-1/ 



/CI 




Vo 





r 3 

^8 






o\ 




V 



/Cs 





Cs 



in PGL(4, C). So, replacing a by a 5 by an outer automorphism a 
of Qi 6 if necessary, we may assume that a is either 

/c 



o\ 



V 

a 5 and b 1 



01 



/Cs 





°\ 





CfT 1 








1 





\o 





V 



or a 2 



In each case 



/0 

C4 





C4 










±1 






\o 

\ 



±V 



Cs 






-v 



Claim 4.13. a 7^ a\. 



Proof. Assume that a = a\. Then, as before, by detai = 1 and a*u>w — ^w, h 
follows that F4 is a-invariant. Thus F4 must be of the following form: 

F 4 = ax\x\ + I3x 1 x 2 f2{x ?n x4) + f 4 (x3,x 4 ) ■ 

If /3 = 0, then [1 : : : 0] is a singular point of W, a contradiction. If j3 ^ 0, 
we can normalize (3=1. If dctfe = 1, then F4 is ^-invariant by b*ujx = u>x- Thus 
Kf2) = —fi and then f 2 = by the explicit form of b. However, [1 : : : 0] is 
then a singular point of W, a contradiction. If dctfe = —1, then 6(^4) = — F4 by 
b*Ldx = uix- Thus a = 0, 6(/2) = /2 and 6(/4) = — / 4 by the explicit forms of b 
and F4. Then, F4 is of the form 

F 4 = x x x 2 {(i\x\ + 02x1) + Jixlx 4 + 72X3^4 . 
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However, the point [0 : 1 : : 0] is then a singular point of W, a contradiction. □ 

So, a — a<2- By det<22 = — 1, we have a(F±) = — F4. By the explicit form of 
the equation F4 is of the following form: 

F4 = ax\ + (3x\ + ^x\xz + 5x4x1 + 6X1X2X3X4 . 

If a = 0, then (i = 0, because F4 is 6-semi- invariant. However, [1 : : : 0] is 
then a singular point of W, a contradiction. Thus a^O. For the same reason, we 
have j3 7^ 0. If 7 = 0, then [0 : : : 1] is a singular point of W. If 5 = 0, then 
[0 : : 1 : 0] is a singular point of W. Thus 7 ^ and S ^ 0. 

If dct 6=1, then b(Fi) = F4. Thus a = (3 and e = 0. Then, applying a suitable 
linear transform like x\ 1— » ca;i, 0:2 1— > CX2, x 2 1— » rfx2, x% ^ ex^, one can normalize 
the equation of W as in (4.11). 

If dct b = —1, then 6(^4) = —F4. Thus a = —(3 and e = 0. Then, one can again 
normalize the equation of W as in (4.11). This completes the proof of (4.11). □ 

We have now completed the proof of (4.7) and that of (3.1). □ 

5. Solvable K3 groups and nilpotent K3 groups 

In this section, we shall prove proposition (3.2). Throughout this section, we 
denote by G a K3 group acting on X and by 

1 — ► G N — ► G-^fii — ► 1 

the basic sequence. 

The next proposition is a special case of a more general fact in [IOZ] and is 
crucial for our proof: 

Proposition 5.1. Assume that I = 3. Let g be an element of G such that a(g) — 

c 3 . 

(1) Set ordg = 3k. Then (fc,3) = 1. In particular, the basic sequence splits if 
1 = 3. 

(2) Assume that ordg = 6. Let P G X 9 . Then there is a local coordinate (x,y) 
at P such that either g* (x , y) = {Q 1 x,(iy) (type (1)) or g*(x,y) = {Q 5 x,(6y) 
(type (5)). Letmi, m 5 be the numbers of points of type (1) and of type (5). Then 
(1711,1715) is either (2, 0) 7 (4, 1) or (6, 2). 

(3) Assume that ordg = 12. Let P e X 9 . Then there is a local coordinate (x,y) 
at P such that either g*(x,y) = {C^xX^v) ( l yP e 9*(x,y) = (CiT^. Ci 7 2 2/) 
(type (3)), org*(x,y) = ((i 2 9 x, C12Z/) (type (9)). Let mi, mz, mg be the numbers 
of points of types (1), (3), (9) respectively. Then (mi, 1713, mg) is either (1,0,0) 
or (2, 1,1). 

Proof. For the convenience to the readers, we shall give a proof for this special case. 
A more general treatment will be in [IOZ]. 

Let us show (1). If otherwise, k — 3 or 6 by g 3 G Gn and by (2.2). So, it 

3 

suffices to show that k ^ 3. Assume k = 3. Then ordg = 9 and X 9 C X 9 . Since 
X 9 is a 6-point set by (2.2), X 9 is also a finite set. Let P e X 9 . Then, since 
ordg = 9, g*uJx = (3^x, and P e X 9 is isolated, there is a local coordinate (x,y) 
at P such that either g*(x, y) = (( g ~ 1 x, C|y) (type (1)), g*(x, y) = ((g 2 x, C$y) (type 
(2)) or g*(x,y) = Xg 7 x,(gy) (type (7)) holds. Let mi, m 2 , my be the numbers of 
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fixed points of types (1), (2), (7). Then, by the holomorphic Lcfschetz fixed point 
formula, one has: 

2 

i+c 3 - 1 (=E(- 1 )wi^ < (^)) 

i=0 

m\ m,2 m-; 

= (i - c^)(i ci) + (i - c 9 - 2 )(i - ci) + (i - c 9 - 7 )(i - c 9 ) • 

Note that the minimal polynomial of (9 over Q is x e + x 3 + 1 = 0. Now, a direct 
calculation shows that there is no solution (mi, m 2 , ra-j) of the equation above even 
in Q. 

Let us give a proof of (2). For the same reason as in (1), one obtains a list 
of possible local actions of g at P e X 9 as described in (2). Then, again by the 
holomorphic Lefschetz fixed point formula, one has: 

1 + r 1 = ^ + ^ 

3 (l-O(l-d) (1-C 6 - 5 )(1-Ce) ' 

In addition, since X 9 C X g2 and X g2 is a 8-point set by (2.2), one has mi+m 5 < 8. 
Finding all the non-negative integer solutions (mi, m 5 ) in this range, we obtain the 
result. Proof of (3) is similar. □ 

The next lemma completes the assertions (1) and (3) of (3.2). 

Lemma 5.2. (1) IfG N ~ F 12S , then 1=1,2 or A. 
(2) If Gn ^ F 3Si , then I = 1,2 or 4. 

Proof. Let us show the assertion (1). We may assume that X is projective. Since 
Qie < F 12& by (2.6), one has rankT(A) = 2 by (4.4). Thus I = 1, 2, 4, 3 or 6 by 
(2.5). If I = 6, then ^3 < ^7 and H := a -1 ^) is a K3 group such that Hn = F\2& 
and 1 = 3. So, it suffices to show that 1^3. Assume that 1 = 3. Then, by (5.1), 
G = Fi2$ : (g) where a(g) = C3 and ord(#) = 3. Since [^128,^128] - C 2 x D 8 
by (2.6) and since the commutator subgroup is a characteristic subgroup, we have 
a new K3 group K := (C 2 x D$) : (g) such that Kn — C2 x D s and 1 = 3. 
Let c g be the conjugate action by g on C 2 x D 8 . Since C 2 x D s has exactly one 
subgroup isomorphic to C 2 x C4, we have a new K3 group H = (C 2 x C4) : (g) 
such that H N = C 2 x C 4 and 7 = 3. Since C 2 x C4 contains exactly four order 4 
elements, c 9 fixes one of them, say r. Since there is then exactly two invulutions a 
such that C 2 x C4 = (<j, r), the conjugate action c 9 also fixes one of such a. Hence, 
H = (C 2 x C4) x (<?). Consider the element h = rg. Then ord h = 12 and a(/i) = ^3- 
Let Mj be the set of type (i) points of X h in (5.1)(3). Then, by (5.1)(3), one of M t 
is a one-point set, say M = {P}. Since H is commutative, we have a(P) = P for 
all a € -ffjv- However, one would then have 

C 2 x C4 = Hpf < SL(T XjP ) ~ SL(2, C) , 

a contradiction to the fact that finite abelian subgroups of SL(2, C) must be cyclic. 

Let us show the assertion (2). Note that F 384 = (Fi 2S ,t) for some element 
t of order 3, and the Sylow 2-subgroups of F384 are exactly Fi 2 8, t~ 1 F\2 8 t and 
t~ 2 Fi 28 t 2 . For the same reason as in (1), it suffices to show that 1^3. Assume 
that 1 = 3. Then, by (5.1), G = F 384 : (g) where a(g) = C3 and ord(fif) = 3. 
Consider a Sylow 3-subgroup H of G containing r. Since \G\ = 2 9 • 3 2 , we have 
\H\ = 3 2 . Since \Gn\ = 2 9 • 3, there is an element h € H such that a(h) = (3. This 
element h also acts by the conjugate on the set {Fi 2 s, t~ 1 F\2s,t 1 t~ 2 Fi2st 2 } of Sylow 



14 



K. OGUISO 



2-subgroups of Gn- Thus, replacing h by hr l if necessary, we have h~ 1 Fi2sh = F128, 
and a new K3 group K = (Fus , h) . Since a(h) = (3 and h is an element of a 3-group 
H, we have ordh = 3 and K = F\ 2 s ■ (h) by (5.1)(1). However, this contradicts 
(5.2)(1). □ 

In the rest of this section, we prove (3.2)(2) and (4). 



Proof of (3.2) (2) 

The next proposition is obtained by [Mu] in the course of his proof of (2.3). For 
the notation of groups, we follow [Mu]. 

Proposition 5.3. [Mu, proposition 5.2 and theorem 5.5] Let Gn be a solvable 
symplectic K3 group. Then, Gn and its order (indicated by [*]) is either 

(1) 2-group [ 2™ , < n < 7} ; 

(II) 2-3-group [2"3 , < n < 7] ; moreover, if it is nilpotent, then Gn is isomorphic 
to C 3 , C 6 or C 2 x C 6 ; 

(III) 9 I \Gn\ and Gn is either 

Cg [9] ; A 3 , 3 ,C 3 x5 3 [18] ; S 3 x S 3 , C\ :C 4 ,4 4 xC 3 [36] ; N 72 , M 9 , A 4 , 3 [72] ; 

At x A A [144] , At,4 [288] ; 

(IV) 5 I |Gjv| and Gn is either 

c 5 [5] , Di (= e 5 : e 2 ) [10] , e 5 : e 4 [20] , c\ ■. c 5 [so] , 

C\: Di [160] ; 

('V; 7||Gat| a«rf Gat is eif/ier G 7 [7] , G 7 : G 3 [21]. 

Let us show (3.2) (2) dividing into the 5 cases (I) - (V) in (5.3). By (5.3), we 
may assume that I > 2. Then X is projective as well. 

First we consider the case where Gn lies in (III), (IV), (V). 

Lemma 5.4. (1) If Gn is in the case (III), then I < 12. 

(2) If G N is in the case (IV), then I < 12. 

(3) If Gn is in the case (V), then I < 6. 

Proof. First we shall show (1). Choose a subgroup Gf ~ (n,^) < Gn- Then, by 
(4.5), one has 

94 4- fi x 8 

rankiJ 2 (X,Z) G " < rank# 2 pf, Z)< Tl < r2 > = — — --2 = 6. 
Thus rankT(X) < 5 and we have I < 12 by (2.5). 

Proofs of (2) (resp. (3)) are similar if we choose a subgroup G5 (resp. G7) in 
Gat: 



ranki? 2 (X,Z) G " < r&nkH 2 {X, Z) c ' 5 = 24 + 4 x 4 _ 2 = 6 ; 



ra,nkH 2 (X,Z) GN < rank H 2 (X , Zf 7 = 



2 (Y7 ,C 7 _ 24 + 3x6 



-2 = 4. 



□ 
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Thus, when G N is in (III), (IV), or (V), we see that |G| = |Gjv| •/ < 2 9 • 3 unless 
Gn is one of 

(i) C 2 : D w , (ii) A x A , (Hi) A,4 . 
In case (i), we have C| : C5 ~ H < Gn- Here the order structure of iJ, which 
is also a subgroup (with no order 10 element) of the affinc transformation group 
F| : GL(4,F 2 ), is as follows: 



order 


1 


2 


5 


cardinality 


1 


15 


64 



Then, one has 

rank H 2 (A, Zf" < rank if 2 (X, Z) H = 24 + 8 '15 + 4-64 _ g = g 

80 

Thus, rankT(A) = 2 and I < 6. Hence \G\ < 160 • 6 = 960 < 2 9 • 3. 

Similarly, in case (ii), using the order structure of Gat = A x A below 



order 


1 


2 


3 


6 


cardinality 


1 


15 


80 


48 



one can calculate 



ranki? 2 (A,Z) Giv = 



24 + 8 • 15 + 6 • 80 + 2 • 48 
144 



-2 = 3. 



Thus, rankT(A) = 2 and I < 6. Hence \G\ < 144 • 6 = 864 < 2 9 • 3. 

Note that A 4 x A 4 < A iA (:— (S4 x S4) n A s ). Then, from the calculation above, 
we also find that I = 1, 2, 3,4 or 6 for G N = A,4- Note that \A 4A \A = 1152 < 2 9 -3, 
but 1^4,4! • 6 = 1728 > 2 9 • 3. However, we can show the following: 

Lemma 5.5. If Gn — A 4A , then I ^ 3, 6. 

Proof. As in (5.2), it suffices to show that 7^3. Assume that 1 = 3. Then, by 
(5.1), G = A4.4 : (g) where a(g) = C3 and ord(<?) = 3. Since [A4.4, ^4,4] — A4 x ^4 4 
and since the commutator subgroup is a characteristic subgroup, we have a new 
K3 group H := (A4 x A4) : (g) such that Hn ~ At x At and 1 = 3. Note that 
At = Cf : C 3 so that H N = A x A = C\ : Cf . Let H 3 be a Sylow 3-subgroup of 
H containing Cf . Since \H\ — 2 4 • 3 3 , we have \H 3 \ = 3 3 . Note that H 3 acts on iJ 



N 



by the conjugate, say p. Since Cj is the normal Sylow 2-subgroup of Hn (so that 
a characteristic subgroup of H N ), the conjugate action p makes C\ stable, and we 
have a group homomorphism 

p:H 3 — » Aut(G 2 4 ) ~GL(4,F 2 ) . 

Here |GL(4, F 2 )| = 2 6 -3 2 -5-7. Thus, there is a non-trivial clement h £ Ker p. Since 
Cf (= HsCiHn) acts on C| faithfully, this h satisfies a(h) = (3 (after replacing h by 
h^ 1 if necessary). Moreover, ord(/i) = 3™ (by /i e iJ 3 ), and we have ord(fe) = 3 by 
(5.1). Thus, we obtain a new K3 group K = x (/i) such that K N = G| and 1 = 3. 
Let <t be an involution in C|. Then /icr is of order 6 and satisfies a(ho~) = £3. Let Mj 
be the set of type (i) fixed points of X ha described in (5.1)(2). Then, by (5.1)(2), 
one of Mi is an at most 2-point set, say M = {P, Q}. Since K is commutative, 
we have a({P,Q}) = {P, Q} for all a e K n- Then, one would have an index 2 
subgroup G 2 < K N (= C\) such that Cf < SL(T x ,p) ^ SL(2, C), a contradiction 
to the fact that finite abelian subgroups of SL(2, C) must be cyclic. □ 
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Next, we consider the case (I), i.e. the case where Gn is a 2-group. Set |Gjv| = 
2™. By (2.3) and (2.4), we have Gn < F\2% (as abstract groups). In particular, 
n < 7 and if n = 7, then Gn — Fi28- So, by taking (5.2) into account, it suffices to 
show that \G\ < 2 9 if n< 6. 

Let us first consider the case where Gn has an order 8 element, say r. In this 
case, we have 

rank77 2 (X, Z)*» < ranki7 2 (X, Z)<'> = ^+8x1+4x2+2x4 -2 = 4. 

8 

Thus, 7 < 6 and we have |G| < 2 6 • 6 < 2 9 . 

Next we consider the case where Gn has no element of order 8. Then, we have 
the following order structure of Gat: 



order 


1 


2 


4 


cardinality 


1 


2k + 1 


2m 



where k + m = 2™" 1 - 1. Moreover, k < 17 by G N < F 128 and by (2.6)(1). 
If n = 6, then fc + m + 1 = 2 5 and one has 

rank H\X, Z)°» = ^ + 8(2fc + 1) + 4 ■ 2m _ 2 = 2 + 24 + 8fc < g . g < 4 

Here the last inequality is because < 17. Hence, rankT(X) < 3 and we have 
7 < 6. Thus |G| < 2 6 • 6 < 2 9 . 

If n = 5, then k + m = 15 and fc < 15. Thus, one has 

, lr ,„, mr 24 + 8(2/c + l)+4-2m „ „ 24 + 8fc „ 
rank77 2 (X,Z) G " = ^ ^ 2 = 2+ ~ 5 <7,i.e. <6. 

Hence, rankT(X) < 5 and we have 7 < 12. Thus \G\ < 2 5 • 12 < 2 9 . 

Assume that n < 4. Then, if |G| > 2 9 , we have 7 > 2 5 = 32. In this case, 
one can check that <p(I) > 12 (see, for instance, the explicit list in [MO]). Then, 
\G N \ < 2 by the next lemma. We have then \G\ < 2 • 66 < 2 9 . 

Lemma 5.6. Let G be a K3 group on X. If <p(I) > 12. Then \G N \ < 2. 

Proof. By f(I) > 12 and by (2.5), we have rankT(X) > 12. Let g be a non-trivial 
element of Gn- Then g*\T(X) = id and g fixes at least one ample class. Thus, 

tr ( 5 *|NS(X)) > 1 + (-1) • (22 - rankT(X) - 1) = rankT(X) - 20 . 

We also note that this inequality is strict if ordg = 3. Combining this with the 
topological Lefschetz fixed point formula, one has 

\X 9 \ = e(X 9 ) = 2 + tr( 5 *|NS(X)) +tr (g*\T(X)) > 2rankTpf) - 18 > 6 . 

Thus, g is an involution by (2.2) and by the remark above. Then, Gat ~ GJ for 
some n and one has by (4.5) 

ranki7^,Z)^ = 24 + 8 ( 2 "- 1 )-2 = 6 + ^. 

Since rankT(X) < ranki7 2 (X, Z) Gjv , we have then 

„ 16 



> 12 , i.e. n = , 1 . 

2" 



□ 
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Finally we consider the case (II), i.e. the case where Gn is of order 2™ • 3. Then 
n < 7 and if n = 7, we have Gn — -^384 by (2.3). The case n = 7 is settled by 

(5.2) . Let H be a Sylow 2-subgroup of Gn- Then \H\ = 2™. By the argument in 
the case (I) and by the fact that H 2 (X, Z) Gn C H 2 (X, Z) H , we have / < 6 if n = 6 
and J < 12 if n = 5. Then |G| < 2 9 • 3 for n = 5, 6. Assume that n < 4. Then, if 
\G\(= \G N \ ■ I) > 2 9 • 3, then we have / > 32 and ip(I) > 12. Then, by (5.6), we 
would have \Gn\ < 2, a contradiction. Thus \G\ < 2 9 • 3 as well. Now we are done. 

Proof of (3.2) (4) 

Let us show the assertion (3.2)(4). Since G is nilpotent, Gn is also nilpotent. 
The previous argument for the solvable case already settled the case when Gat is 
in (I) of (5.3). If a nilpotent group Gn is in (II) of (5.3), then \Gn\ < 12 and 

ranktf 2 (X, Z) G « < rankff 2 (A, Zf 3 = 24 + 6 ' 2 - 2 = 10 . 

3 

Thus, rankT(A) < 9 and <p(I) < 8. This implies / < 30 (see eg. an explicit 
list in [MO]). We have then \G\ < 12 • 30 < 2 9 . If Gat is in (III), (IV) or (V) of 

(5.3) , then Gat is either G5, G7 or Gf . (Recall that a nilpotent group must be the 
direct product of its Sylow subgroups.) Thus |Gat| < 9. Hence by (5.4), we have 
|G| < 9 • 12 < 2 9 as well. Now we are done. 

6. Invariant polarization of a maximal nilpotent K3 group 

In this section, we shall prove proposition (3.3) along a similar line to [Ko2] 
and [OZ]. First, we recall some basic facts on the Niemeier lattices needed in our 
arguments. As in [OZ], our main reference concerning Niemeier lattices and their 
relations with Mathieu groups is [CS, Chapters 10, 11, 16, 18]. 

Definition 6.1. The even negative definite unimodular lattices of rank 24 are 
called Niemeier lattices. There are exactly 24 isomorphism classes of the Niemeier 
lattices and each isomorphism class is uniquely determined by its root lattice R, 
i.e. the sublattice generated by all the roots, the elements x with x 2 — —2. Except 
the Leech lattice which contains no root, the other 23 lattices are the over-lattices 
of their root lattices. 

We denote the Niemeier lattice N whose root lattice R by N(R). Among 24 
Niemeier lattices, the most relevant one for us is N(Af 2i ). Two other Niemeier 
lattices N(Af 12 ) and N(Af 8 ) will also appear in our argument. 

Let N = N(R) be a non-Leech Niemeier lattice. Denote by O(N) (resp. by 
O(R)) the group of isometries of N (resp. of R) and by W(N) = W(R) the Weyl 
group generated by the reflections given by the roots of N. Here O(N) < O(R) and 
W(N) is a normal subgroup of both 0{N) and O(R). The invariant hyperplanes 
of the reflections divide N ® R into finitely many chambers. Each chamber is a 
fundamental domain of the action of W{R). Fix a basis 1Z :— {r,} 2 l 1 of R consisting 
of simple roots. The quotient group S(N) := 0(N)/W(R) is then identified with 
a subgroup of the full symmetry group S(R) := 0(R)/W(R) of the distinguished 
chamber C := {x e N ® R|(ar, r) > , r <E 1Z}, or a bit more concretely, S(N) and 
S(R) are subgroups of a larger group 5 2 4 as: 

S(N) = {g g S(R) \g{N/R) = N/R} < S(R) = Aut graph (ft) < Aut set (2) - S 2 ± , 
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where the action by S(R) on N/R(c R* / R) is induced by the natural action on 
R*/R. Here and hereafter, we denote by M* the dual lattice of a non-degenerate 
lattice M and regard M naturally as a submodule of finite index of M* . 

The groups S(N) are explicitly calculated in [CS, Chapters 18, 16]. (See also 
[Kol].) We need the following: 

Proposition 6.2. [CS, Chapters 18, 16] Let N be a non-Leech Niemeier lattice. 
Then, 

(1) S(N) = M 24 tfN = N(Af 24 ); 

(2) S(N) = C 2 .M 12 ifN = N(A® 12 ); 

(3) S(N) = C 2 : (C® 3 : L 3 (2)) if N = N(Af s ); and 

(4) for other N, S(N) is a subgroup of either 2.Sq or 3.Sq. 

Let us add a few remarks about the groups in (6.2)(l)-(3). 

In case (1), i.e. the case where N = N(R) and R = Af 2i , we observe that 

C 24 := N/R ~ F® 12 C R*/R = ® 2 i l ¥ 2 r i ~ F® 24 . 

Here f* := r i /2modZr i . We note that TZ — {ri} 2 ^ forms a Dynkin diagram of 
type Af 24 . 

Let V(TZ) be the power set of TZ. Then, we can identify V(1Z) with R* /R by the 
following bijective correspondence: 

l : V(1Z) 3 A^r A :=^Y, r i (modi?) e R*/R = (A® 2A )* / A® 2A . 

rj£A 

In what follows, we freely identify these two sets, and we define \x\ (x £ R* / R) 
to be the cardinality of l^ 1 {x). 

Then, under the identification by t, it is well known that 0, 1Z £ C24 and that 
if A e C 24 {A ^ TZ, 0) then \A\ is either 8, 12, or 16. We call A e C 2i an Octad 
(resp. a Dodecad) if \A\ = 8 (resp. 12). Note that B e C 24 with \B\ = 16 is of 
the form TZ — A for some Octad A. It is also well known that the set of Octads 
forms a Steincr system St(5, 8, 24) of TZ and generates C24 as F 2 -linear space. In 
this case, the embeddings S(N) < S(R) < S 2 4 explained above coincide with the 
natural inclusions M 24 < #24 = #24 for N = N(Af 24 ). 

In the second case, the Mathieu group M\ 2 — W{N)/C 2 acts naturally on the 
set of 12 connected components of the Dynkin diagram Af 12 and C 2 interchanges 
the two vertices of all the components. We also note that \M 12 \ = 2 6 ■ 3 3 ■ 5 ■ 11. 

In the third case, we identify (non-canonically) the set of eight connected com- 
ponents of the Dynkin diagram A® 8 with the three-dimensional linear space F® 3 
over F2 by letting one connected component to be 0. The group C 2 : (C® 3 : £3(2)) 
is the semi-direct product, where C 2 interchanges the two edges of all the compo- 
nents, C® 3 is the group of the parallel transformations of the afiine space F® and 
L 3 (2)(~ L 2 {7)) is the linear transformation group of F® 3 . 

As in [Ko2] and [OZ], the next embedding theorem due to Kondo [Kol] is an 
important ingredient in our proof: 

Theorem 6.3. [Kol, Lemmas 5, 6] Let K be a symplectic K3 group on X. Set 
L := H 2 {X, Z), L K := {x E L \ h(x) = x (V/i G K) } and L K :=' {y e L\ (y, x) = 
0(Vx e L K )}. Then, 

(1) There is a non-Leech Niemeier lattice N such that Lk C N. Moreover, the 
action by K on Lk extends to an action on N so that Lk — Nk and that N K 
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contains a root, say r° . Here the sublattices N and Nk of N are defined in the 
same way as L K and Lk of L. 
(2) Take TZ so that r° G TZ. Then, the group action by K on N preserves the 
distinguished Weyl chamber C with respect to TZ, and the naturally induced ho- 
momorphism K — > S(N) is injective. 

Corollary 6.4. [Kol] Under the notation of (6.3), one has: 

(1) rank A K = rankL K + 2. 

(2) (L K )*/L K ~ (N K )*/N K . In particular, \detN K \ = \detL K \. 

Proof. The assertion (1) follows from rankiV^ = 24 — rank Nk, ra,nkL K = 22 — 
TankLpc, and Nu ~ Lh- Since L and N are unimodular and since the embcddings 
L K C L and N K C N are primitive, we have a natural isomorphisms (L K )* / L K ~ 
(L K )*/L K and {N K )*/N K ~ (N K )*/N K . Now the result follows from L> ~ TV^. 
For the last equality, we may just note that |det M| = |M*/M| for a non-degenerate 
lattice M. □ 

We are now ready to prove (3.3). Let G be a K3 group on X such that \G\ = 2 9 . 
We denote by K := Gn, the symplectic part and by I the transcendental value. By 
(3.2), K = F\28 (as abstract groups) and 1 = 4. In particular, X is projective. We 
have also ranki^ = 3 by K = F 128 > Qw and by (3.1)(1). Thus, rankT(X) = 2 
and NS(X) G = NS(X) K = ZH for some ample class H. As in (6.3), we set 
L := H 2 (X, Z). We shall fix these notations until the end of this section. 

It remains to show (H 2 ) = 4. This will be completed in (6.11). 

Let us first determine the Niemeier lattice N for our K. 

Lemma 6.5. The Niemeier lattice N in (6.3) for K is N(Af 24 ). 

Proof. By (6.3)(2), \S(N)\ must be divied by \K\ = 2 7 . Thus, N is either N(Af 24 ), 
N(Af 12 ) or N(Af s ) by (6.2). Suppose that the second case occurs. Since K fixes at 
least one element in TZ by (6.3)(1), we have K < M\i. However, this is impossible, 
because \K\ = 2 7 and \M 12 \ — 2 6 • k ((2, k) = 1). Suppose that the third case 
occurs. Again for the same reason above, we have K < C2-L^(2). However, this 
is impossible, because \K\ = 2 7 and |C2.L3(2)| = 2 4 • k! ((2, k') = 1). Now we are 
done. □ 

From now we set N := N(Af 24 ), R := Af 24 and take TZ = {n}^ as in (6.3)(2). 
By (6.2) and (6.3)(2) and (6.5), we have 

K < M 2i < S 2 4 = Aut graph (7e) = Aut set (ft) . 

Lemma 6.6. The orbit decomposition type oflZ by K is [1,1,2,4,16]. 

Proof. Note that ranki? K = rankA K = 5 by rankL K = 3 and by (6.4) (1). Thus 
TZ is divided into exactly 5 if-orbits. Since if is a 2-group and K fixes at least one 
element by (6.2)(1), the orbit decomposition type is of the form [1, 2 b , 2 C , 2 d , 2 e \. We 
may assume that < b < c < d < e. In addition, 1 + 2 b + 2 C + 2 d + 2 e = \TZ\ = 24. 
It is now easy to see that (b, c, d, e) = (0, 1, 2,4). □ 

By (6.6), after re- numbering of the elements of TZ, we have 

R K = (si,s 2 ,s 3 ,s 4 ,s 5 ) 

where 



si = n , s 2 = r 2 , s 3 = r 3 + r 4 , s 4 = r 5 H h r 8 , s 5 = r 9 H h r 24 . 
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Lemma 6.7. 



AT K i S1+S2 + S3 + S4 S 5 

N ={81,82,83, 2 '"2") ' 



In particular, (N K )*/N K ~ Z/4 Z/8 © Z/8. 

Proof. Since R K C N K C (R*) K = (si/2, s 2 /2 , s 3 /2, s 4 /2 , s 5 /2), the lattice 
iV^ is generated by R K and by the (representatives of) if-invariant elements of 
C24. Let us find out all such elements in C24. In what follows, we freely identify 
C24 with a subset of V(1Z) by 1, as it is explained after (6.2). By the shape of the 
orbit decomposition (6.6), there is no if-invariant Dodecad. Moreover, for the same 
reason, if there is a if-invariant Octad, then it must be 

(ri +r 2 + r 3 + r 4 + r 5 + r 6 + r 7 + r 8 )/2 = (si + s 2 + s 3 + s 4 )/2 , i.e. 

{n. , r 2 , r 3 , r 4 , r 5 , r 6 , r 7 , r 8 } . 

Let us show that this is indeed an Octad, i.e. an element of C24. Recall that the set 
of Octads of C24 forms a Steiner system St(5, 8, 24) of 1Z. Then, there is an Octad 
A e C2 4 containing 5-element set {n, rs, r§, r-j, r%}- Note that 

K({n,r 5 ,r 6 ,r 7 ,r 8 }) = {r 1 ,r 5 ,r 6 ,r 7 ,r 8 } 

by (6.6) and by S\, s 4 € i?^. Then, by the Steiner property, we have A = g(A) for all 
g e K. Thus, this A is a if-invarinat Octad. The argument here shows the existence 
of a if-invariant Octad. So, the only one possible candidate (s\ + s 2 + S3 + s 4 )/2 
is indeed a ^-invariant Octad. 

Since length- 16 element of £24 is the complement of an Octad, it follows that 
{r g , no, • • • , r 1& } is the unique length-16, if-invariant element of C24. Hence 



that is, 



j. T K 1 s i + s 2 + «3 + «4 s 5 
N = {S 1 ,S 2 ,S 3 ,S4,S 5 ,—) 



AT K 1 S1+S2 + S3 + S4 S 5 

N =(s 1 ,s 2 ,s 3 , 2 '"2"/- 



The intersection matrix of N K with respect to this basis is 

(1 1 0\ 
2 1 
4 2 
112 4 
\0 8/ 

and the elementary divisors of this matrix is (1,1,4,8,8). This implies the result. 

□ 

Lemma 6.8. (1) (L K )*/L K ~ Z/4 Z/8 Z/8. In particular, \detL K \ = 2 s . 
(2) IfxG L K , then (x 2 ) = modA. 

Proof. The assertion (1) follows from (6.7) and (6.4) (2). By ranki^ = 3 and by 
(1), we can choose an integral basis (fi,f 2 , f 3 ) of (L K )* so that (4/1,8/2, 8/3) forms 
an integral basis of L K . For x = x\ ■ 4/i + x 2 ■ 8/2 + 2:3 • 8/3 (xi € Z), one has 

(x 2 ) =4x 1 (x,/ 1 ) + 8x 2 (a;,/2)+8x3(x,/3) G 4Z . 

This implies the second assertion. □ 
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Lemma 6.9. With respect to a suitable integral basis (vi,v 2 ) ofT(X), the inter- 
section matrix of T(X) becomes the following form: 

'Am 



4m 



for some m <G Z . 



Proof. By (2.5), we have an isomorphism T(X) ~ Z[v / — 1] as Z[v / — T]-modules. 
Since \J~^\ acts on the integral basis (ei := l,e2 := V—T) of Z\\f— 1] as ei i— > e 2 , 
e 2 i ^ — ei, the group G/if = (g mod if) ~ ^ 4 acts on the corresponding inte- 
gral basis (wi,«2) of T(X) by .g*(«i) = v 2 and g*(v 2 ) = —v\. Thus (wi,U2) = 
(5*( w i)>5*(«2)) = {v2,-vi), and(wi,w 2 ) = 0. Similarly, (vi,vi) = (g*(vi),g*{v!)) = 
(v2,V2)- The result now follows from these two equalities and (6.8)(2). □ 

Lemma 6.10. Set I := [L K : ZH ® T(X)]. Then I = 1 or 2. Moreover, if I = 2,. 
then 

£ = Z( ,«i,f 2 ) • 

ifere {v\,v 2 ) is an integral basis ofT(X) as in (6.9). 

Proof. Assume that I > 2. Since T(X) and H are both primitive in L K , we have 

T K rj, H + b Vl + cv 2 
L =Z(vi,V2, ; ) 

for some integers b, c such that < b, c < I — 1. By considering the action by 
G/K = (gmodGjv) ~ (14, we have 

t k * , H + bv\ + cv 2 . _ H + bv 2 — evi 
L 39 ( I > I • 

Here we used g*(vi) — v 2l g*(v 2 ) = —v\ (by the proof of (6.9)) and the fact that 

H is G-invariant. Thus 

(b + c) Vl + (c - 6)k 2 x 

Since T(X) is primitive in we have l\b + c and Z | c — b. Thus, l\2b and l\2c. Since 
< 6, c < Z — 1, it follows that 2b = or 26 = I and 2c = or 2c = /. If 6 = c = 0, 
then if// S L^, a contradiction to the primitivity of H . If 26 = I and c = 0, then 
H/l + vi/2 e L K . Applying g, we have H/l + v 2 /2 e L K . Thus (vi -v 2 )/2e L K , 
a contradiction to the primitivity of T(X) C L K . We get a similar contradiction 
when 6 = and 2c = I. Hence 6 = c = 1/2 and we have H/l + (v\ + v 2 )/2 e L K . 
Since v x + v 2 e L K , it follows that 2H/1 e Thus ? = 2 (when Z > 2) by the 
primitivity of H, and 6 = c = 1. □ 

The next lemma completes the proof of (3.3). 

Lemma 6.11. (H 2 ) = 4. 

Proof. By (6.8) (2), we can write (H 2 ) = An for some positive integer n. We need 
to show that n = 1. Let m be a positive integer in (6.9). 

First consider the case where I = 2 (Here I is the index defined in (6.10)). In 
this case, we have by (6.8) (1) 

4 • 2 8 = I 2 ■ dct L K = {H 2 )- dct T{X) = An ■ 16m 2 . 

Thus nm 2 = 16. Moreover, by (H + v\ + v 2 )/2 e L K and by (6.8)(2), we have 

n + 2m = ((H + vi+v 2 )/2) 2 ) = 0mod4. 
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Thus (m,n) = (2,4) and the intersection matrix of L K (with respect to the basis 
in (6.10)) becomes 

4 4^ 
4 8 

V 4 8 / 

However, the elementary divisors of this matrix is (4,4,16), a contradiction to 
(6.8)(1). 

Next consider the case where 1 = 1. In this case, we have 

2 s = dcti Gw = (H 2 ) ■ detT(X) = 4n • 16m 2 . 

Thus nm 2 = 4 and (m,n) is either (1,4) or (2,1). Assume that (m, n) = (1,4). 
Then, the intersection matrix of L K = ZH ® T(X) (with respect to the basis 
(H, Vi,V2)) becomes 

'16 N 
4 
4, 

However, the elementary divisors of this matrix is (4,4,16), a contradiction to 
(6.8)(1). Thus (m,n) = (2, 1) and we are done. □ 
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